Methods and systems for performing charting tasks

ABSTRACT

A method for accessing information on an electronic version of an navigation information display is described. The method includes displaying navigation information on a display of a device, the device incorporating a touch screen, sensing a user touch on the touch screen, determining, by the device, a location on the touch screen where the user touch has occurred, correlating the location on the touch screen where the user touch has occurred with a location on the navigation information display, and displaying a magnified area of a portion of the navigation information proximate the location on the touch screen where the user touch occurred.

BACKGROUND OF THE INVENTION

This invention relates generally to aircraft cockpit displays and moreparticularly, to methods and systems for performing charting tasks onaircraft cockpit displays.

At least some known aircraft include cockpit displays use charts andother information displays that aid in navigation and situationalawareness. For example, charts displayed on electronic displays,referred to herein as electronic charts, typically are used for a widevariety of aspects of flight and flight planning. However, certainelements on such electronic charts are difficult to read. Whilemagnification of such on the displays is known, such systems are limitedto the magnification of the entire chart or display even though thecontext of the information may be reduced when zoomed in to a levelrequired for readability. Outside of magnifying the entire chart, thereare no known systems or methods that allow for enhanced readability ofspecific electronic chart elements, particularly under low lightconditions. Further, cumbersome zooming of the entire area display maysometimes result in a desired portion of the information beingoff-screen in order to view a second portion of the information.Finally, the attention that a pilot has to utilize when zooming in andzooming out on an electronic chart would be better utilized elsewhere.

It is apparent that an approach to viewing of relevant information aboutthe points on an electronic chart, for example, latitude/longitude,radial and distance to a VOR outside of zooming in and out on anelectronic chart would be beneficial to aircraft operation.

BRIEF DESCRIPTION OF THE INVENTION

In one embodiment, a method for accessing information on an electronicversion of a navigation information display is provided. The methodincludes displaying navigation information on a display of a device, thedevice incorporating a touch screen, sensing a user touch on the touchscreen, determining, by the device, a location on the touch screen wherethe user touch has occurred, correlating the location on the touchscreen where the user touch has occurred with a location on thenavigation information display, and displaying a magnified area of aportion of the navigation information proximate the location on thetouch screen where the user touch occurred.

In another aspect, one or more computer-readable storage media havingcomputer-executable instructions embodied thereon are provided. Whenexecuted by at least one processor, the computer-executable instructionscause the at least one processor to display navigation information on atouch screen display of a device associated with the at least oneprocessor, sense a first user touch on the touch screen, determine, bythe device, a location on the touch screen where the first user touchhas occurred, correlate the location on the touch screen where the firstuser touch has occurred with a location in the navigation information,and display at least one charting tool proximate the location on thetouch screen where the first user touch occurred, the charting tooloverlaid over the navigation information.

In still another aspect, a system for displaying electronic navigationcharts is provided. The system includes a processing device, a memorycoupled to the processing device, the memory for storing data definingthe electronic navigation charts, and a display comprising a touchscreen communicatively coupled to the processing device. The processingdevice is configured to cause the electronic navigation charts to bedisplayed on the display, receive data from the touch screen indicatingone or more user touches on the touch screen, determine, based on thedata received from the touch screen, a location on the touch screenwhere the one or more user touches have occurred, correlate the locationon the touch screen where the one or more user touches have occurredwith the data defining the electronic navigation charts, and cause atleast one charting tool to be displayed on the display proximate thelocation on the touch screen where the one or more user touchesoccurred, the at least one charting tool overlaid over the electronicnavigation charts.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a forward perspective view of an exemplary aircraft cockpitdisplay panel that includes at least one display screen in accordancewith an embodiment of the present invention;

FIG. 2 is an illustration of an aviation chart including a magnifiedarea overlaid thereon.

FIG. 3 is an illustration of the aviation chart of FIG. 2 with themagnified area more usefully positioned over a VOR (VHF omnidirectionalrange) marker.

FIG. 4 is an illustration of a display where the aviation chart of FIG.2 takes up only a portion of a display, thereby defining a non-chartportion of the display.

FIG. 5 is an illustration of a multiple touch capability operable tooverlay a magnetic bearing and distance between two user touch points onthe aviation chart of FIG. 2.

FIG. 6 is a flowchart illustrating a process for causing a magnifiedarea to be displayed on the aviation chart of FIG. 2.

FIG. 7 is a diagram of a data processing system.

DETAILED DESCRIPTION OF THE INVENTION

The described embodiments are directed to the implementation of virtualtools for use while performing typical charting tasks on electroniccharts or other sources of electronic navigation information. Theembodiments may be practiced in any of an aviation, land navigation, orwater navigation environment. One exemplary embodiment is a virtualmagnifying glass that, through touch screen interaction, can be placedover a chart, providing a magnified view of a chosen area of the chart,while also providing readouts of latitude and longitude of the center ofthe area under magnification. Such embodiments allow for themagnification of an area of interest on the electronic without requiringthe user to “zoom in” the entire chart.

Other data can be provided in these magnified areas including, but notlimited to, radial and distance from a VOR, distance to another selectedobject, and others. Contemplated embodiments also include multiple touchinterfaces to allow designation of two points of interest, and a toolthat can be used, along with the afore mentioned two touches, to easilymeasure distance and bearing between the two points of interest.Additional embodiments include a waypoint creation tool, a VOR tool, adistance and bearing tool, and other tools.

The described embodiments, as further described herein, provide enhancedreadability of selected navigation information elements throughmagnification, including readability under low light conditions.Enhanced readability of particular textual elements can be read withoutthe cumbersome zooming of the entire electronic chart. Intuitiveidentification of points of interest through touch interaction, andviewing of relevant information about the points is also provided,including, but not limited to, latitude/longitude, radial and distanceto a VOR, as well as intuitive creation of waypoints through touchinteraction and with improved accuracy due to magnification. Inaddition, the described embodiments eliminate, or at least greatlydecrease manipulation of the electronic chart through the use of acomputer mouse and/or keyboard as is done when utilizing currentelectronic charting methodologies.

By way of introduction, FIG. 1 is a forward perspective view of anexemplary aircraft cockpit display panel 100 that includes at least onedisplay screen 102 in accordance with an illustrative embodiment. In theillustrative embodiment, display screen is positioned on aircraftcockpit display panel 100. In an alternative embodiment, display screen102 is positioned on an auxiliary panel (not shown) located in thecockpit of the aircraft. During aircraft operation, display screen 102is available for viewing by a pilot and/or co-pilot of the aircraft.Display screen 102 may be used to view data included in an electronicflight bag (not shown), which may be embodied as a standalone devicesuch as, but not limited to a PDA or laptop PC, or as a softwarecomponent of a system executing on a processor that is part of asubsystem of the aircraft.

In the exemplary embodiment, the electronic flight bag includes anelectronic storage device configured to store various user-configurableflight-related objects for all required and desired information for aparticular flight, such as flight routes, as defined by, for example,way-points, airport information, temporary flight restrictions, andweather information as well as any other user-defined objects associatedwith a flight, ground operations, and/or flight planning. Certain ofthese include electronic versions of aviation charts and/or navigationcharts, sometimes collectively referred to herein as electronic charts.The electronic flight bag receives data from various aircraft and groundsensors and systems, determines flight information based on the receiveddata in real-time, and displays the flight information and/or alerts theflight crew through display screen 102 and other aural and/or visualindicators positioned on cockpit display panel 100. Such flightinformation provides the flight crew with additional situationalawareness during all phases of aircraft operation. In accordance withthe embodiments described herein, the above described examples areconsidered to incorporate one or more touch screens.

FIG. 2 is an illustration of a navigation chart 200 (i.e., an electronicchart) according to one embodiment that is used in aviation. Chart 200is displayed on a display 210. Chart 200 includes a magnified area 220.Magnified area 220 is illustrative of an embodiment of a magnifier fortextual data on aviation chart 200. As shown in FIG. 2, magnified area220 is shown as appearing over the remainder of screen content 222without relevant content within the magnified area 220. The magnifiedarea 220 appears when a user touches the screen portion 230 of thedisplay 210, in one embodiment, for more than two seconds. In anexemplary embodiment, the magnified area 220 is positioned just abovethe point where the user touched the screen portion 230 thereby makingthe magnified area visible even though the user's finger may still betouching the display 210. In various embodiments, users may change thesize of the magnified area 220 through additional user input. In variousembodiments, the magnified area 220 is removed from the display after apredetermined amount of time has passed since a touch by a user on thetouch screen display 210.

As shown, the content of magnified area 220 is magnified, and magnifiedarea 220 is identified by a boundary 240 enclosing the magnified area220. In embodiments, crosshairs 250 may be incorporated within themagnified area 220 to provide a user with a greater degree of accuracywhen using. In embodiments, the user is able to move the magnified area220 over the chart 200 as the user's finger moves across the screenportion 230 of the display 210. As the magnified area 220 is moved, thecontent of the magnified area 220 changes according to the relativeposition of the magnified area 220 with respect to the chart 200 beingdisplayed.

FIG. 3 is an illustration of navigation chart 200 with the magnifiedarea 220 more usefully positioned over the frequency information 260 fora VOR (VHF omnidirectional range) marker, enabling easy reading of theminimum crossing altitude 262 and other data associated with the VORmarker on the chart 200.

FIG. 4 is an illustration of a display 300 where chart 200 takes up onlya portion of display 300, thereby defining a non-chart portion 310 ofdisplay 300. Display 300 is programmed to utilize the non-chart portion310 for textual displays 320. In the illustrated embodiment, the textualdisplays 320 are shown as being above the chart 200 and includelatitude, longitude, distance from, and radial for a VOR marker withinthe magnified area. Textual displays 320 allow for accurateidentification of points on the chart 200, and for display of additionaldata about those points. The data values shown as textual displays 320and on chart 200 are for illustrative purposes only and should not beconsidered as accurate.

FIG. 5 is an illustration of a multiple touch capability operable foruse with chart 200 displayed on display 210. Consistent with theembodiments described above, an arrow 400 extends from a location 402 ofa first user touch of the touch screen of display 210 to a location 404of a second user touch of the touch screen of display 210. Uponrecognition of the user touch locations, the arrow 400 is generated bythe software operable for display 210. In addition and in embodiments, atext box 410 is also generated. In the illustrated embodiment, text box410 includes a magnetic bearing 412 from the location 402 of the firstuser touch to the location 404 of the second user touch as well as adistance 414 between location 402 and location 404. In the illustratedembodiment, this distance 414 is shown in nautical miles. In anembodiment, crosshairs may be incorporated into the display 210 whichallow the user to more accurately place their touch locations.

As easily understood by those skilled in the art, the describedembodiments may also be utilized in the accurate creation of userdefined waypoints for display on chart 200. As discerned from FIGS. 2-5,the embodiments described herein are capable of being implemented on avariety of devices ranging from permanently mounted aircraft displays toportable user devices that have a touch screen, chart displaycapability, and capability to determine location with respect to anelectronic chart. Such hardware and display capabilities are found innumerous consumer devices, for example, so called smartphones and amyriad of portable computing devices.

The described embodiments depend upon a combination of softwaretechniques for manipulating, in real time, the graphical view of thechart 200, and geospatial database processing that can, again in realtime, convert coordinates associated with display 210 (location on thedevice screen that is under the crosshairs or is being touched) tolatitude and longitude or other values.

FIG. 6 is a flowchart 450 illustrating one of the processes that may beperformed by the device upon which chart 200 is displayed. Initially, anelectronic chart such as chart 200 is displayed 452 on the device, suchas a smartphone or permanently mounted aircraft display as describedabove. During operation of the device as an electronic chart display,the device senses 454 a user touch of the touch screen. As describedabove, in embodiments, that touch has to be sensed for a predefinedperiod of time before the device considers the touch an intended touch.The device is programmed to determine 456 the location on the touchscreen where the user touch has occurred. The device then correlates 458the location on the touch screen where the user touch has occurred witha location on the electronic chart such that the device is caused 460 todisplay a magnified area that includes a portion of the electronicchart, the magnified area being overlaid onto the electronic chart.

As described herein, the magnified area may be of a pre-defined or userdefined size, and the magnified area is displayed proximate the locationwhere the user touched the touch screen. As also described, once themagnified area is displayed, the user may utilize a prolonged touch tothe touch screen to move the magnified area, e.g., based upon a sensedpath, about the electronic chart, thereby providing a magnified “window”of at least a portion of the information from the electronic chart thatis “below” the magnified area. A similar process is utilized for the twotouch embodiment, that is, locating on the touch screen the location ofthe two touches that provides the arrow and the bearing and distanceinformation as described above. In the described embodiments, themagnified area and the arrow with bearing and distance information, forexample, may be referred to as a charting tool that is overlaid over thedisplayed aviation chart. In yet another instance, the navigationinformation and the magnified area are displayed in a first portion ofthe display of the device, while textual information related to themagnified area is displayed in a second portion of the display of thedevice.

With the range of devices capable of executing the software necessaryfor generating such displays understood, FIG. 7 is a diagram of onepossible data processing system 500 that might be utilized in providingthe embodiments described herein. As such, data processing system 500 isdepicted in accordance with an illustrative embodiment. In thisillustrative example, data processing system 500 includes communicationsfabric 502, which provides communications between processor unit 504,memory 506, persistent storage 508, communications unit 510,input/output (I/O) unit 512, and display 514.

Processor unit 504 serves to execute instructions for software that maybe loaded into memory 506. Processor unit 504 may be a set of one ormore processors or may be a multi-processor core, depending on theparticular implementation. Further, processor unit 504 may beimplemented using one or more heterogeneous processor systems in which amain processor is present with secondary processors on a single chip. Asanother illustrative example, processor unit 504 may be a symmetricmulti-processor system containing multiple processors of the same type.

Memory 506 and persistent storage 508 are examples of storage devices. Astorage device is any piece of hardware that is capable of storinginformation either on a temporary basis and/or a permanent basis. Memory506, in these examples, may be, for example, without limitation, arandom access memory or any other suitable volatile or non-volatilestorage device. Persistent storage 508 may take various forms dependingon the particular implementation. For example, without limitation,persistent storage 508 may contain one or more components or devices.For example, persistent storage 508 may be a hard drive, a flash memory,a rewritable optical disk, a rewritable magnetic tape, or somecombination of the above. The media used by persistent storage 508 alsomay be removable. For example, without limitation, a removable harddrive may be used for persistent storage 508.

Communications unit 510, in these examples, provides for communicationswith other data processing systems or devices. In these examples,communications unit 510 is a network interface card. Communications unit510 may provide communications through the use of either or bothphysical and wireless communication links.

Input/output unit 512 allows for input and output of data with otherdevices that may be connected to data processing system 500. Forexample, without limitation, input/output unit 512 may provide aconnection for user input through a keyboard and mouse. Further,input/output unit 512 may send output to a printer. Display 514 providesa mechanism to display information to a user.

Instructions for the operating system and applications or programs arelocated on persistent storage 508. These instructions may be loaded intomemory 506 for execution by processor unit 504. The processes of thedifferent embodiments may be performed by processor unit 504 usingcomputer implemented instructions, which may be located in a memory,such as memory 506. These instructions are referred to as program code,computer usable program code, or computer readable program code that maybe read and executed by a processor in processor unit 504. The programcode in the different embodiments may be embodied on different physicalor tangible computer readable media, such as memory 506 or persistentstorage 508.

Program code 516 is located in a functional form on computer readablemedia 518 that is selectively removable and may be loaded onto ortransferred to data processing system 500 for execution by processorunit 504. Program code 516 and computer readable media 518 form computerprogram product 320 in these examples. In one example, computer readablemedia 518 may be in a tangible form, such as, for example, an optical ormagnetic disc that is inserted or placed into a drive or other devicethat is part of persistent storage 508 for transfer onto a storagedevice, such as a hard drive that is part of persistent storage 508. Ina tangible form, computer readable media 518 also may take the form of apersistent storage, such as a hard drive, a thumb drive, or a flashmemory that is connected to data processing system 500. The tangibleform of computer readable media 518 is also referred to as computerrecordable storage media. In some instances, computer readable media 518may not be removable.

Alternatively, program code 516 may be transferred to data processingsystem 500 from computer readable media 518 through a communicationslink to communications unit 510 and/or through a connection toinput/output unit 512. The communications link and/or the connection maybe physical or wireless in the illustrative examples. The computerreadable media also may take the form of non-tangible media, such ascommunications links or wireless transmissions containing the programcode.

In some illustrative embodiments, program code 516 may be downloadedover a network to persistent storage 508 from another device or dataprocessing system for use within data processing system 500. Forinstance, program code stored in a computer readable storage medium in aserver data processing system may be downloaded over a network from theserver to data processing system 500. The data processing systemproviding program code 516 may be a server computer, a client computer,or some other device capable of storing and transmitting program code516.

The different components illustrated for data processing system 500 arenot meant to provide architectural limitations to the manner in whichdifferent embodiments may be implemented. The different illustrativeembodiments may be implemented in a data processing system includingcomponents in addition to or in place of those illustrated for dataprocessing system 500. Other components shown in FIG. 5 can be variedfrom the illustrative examples shown.

As one example, a storage device in data processing system 500 is anyhardware apparatus that may store data. Memory 506, persistent storage508 and computer readable media 518 are examples of storage devices in atangible form. The methods described herein may be encoded as executableinstructions embodied in a computer readable medium, including, withoutlimitation, a storage device or a memory area of a computing device.Such instructions, when executed by one or more processors, cause theprocessor(s) to perform at least a portion of the methods describedherein.

In another example, a bus system may be used to implement communicationsfabric 502 and may be comprised of one or more buses, such as a systembus or an input/output bus. Of course, the bus system may be implementedusing any suitable type of architecture that provides for a transfer ofdata between different components or devices attached to the bus system.Additionally, a communications unit may include one or more devices usedto transmit and receive data, such as a modem or a network adapter.Further, a memory may be, for example, without limitation, memory 506 ora cache such as that found in an interface and memory controller hubthat may be present in communications fabric 502.

As mentioned above, the described embodiments provide enhancedreadability of selected navigation chart elements through magnificationwhich allows for easier reading generally, and especially under lowlight conditions. The embodiments further provide for the enhancedreadability of particular textual elements without cumbersome zooming inand out of the entire chart. Intuitive identification of points ofinterest is provided through touch interaction, and viewing of relevantinformation about the points is provided with improved accuracy due tomagnification. Prior to the embodiments described herein, zooming of theentire chart was required. In addition, accurately specifying points onan electronic chart was problematic as manipulation of a mouse or entryof data via a keyboard was required.

As described, the embodiments take advantage of touch screencapabilities to provide a more intuitive method of identifying a pointof interest on an electronic navigation chart making such embodimentsmore likely to be used, especially in the demanding environment of anaircraft cockpit, seafaring vessel, or for land navigation.

This written description uses examples to disclose various embodiments,which include the best mode, to enable any person skilled in the art topractice those embodiments, including making and using any devices orsystems and performing any incorporated methods. The patentable scope isdefined by the claims, and may include other examples that occur tothose skilled in the art. Such other examples are intended to be withinthe scope of the claims if they have structural elements that do notdiffer from the literal language of the claims, or if they includeequivalent structural elements with insubstantial differences from theliteral languages of the claims.

1. A method for accessing information on an electronic version of anavigation information display said method comprising: displayingnavigation information on a display of a device, the deviceincorporating a touch screen; sensing a user touch on the touch screen;determining, by the device, a location on the touch screen where theuser touch has occurred; correlating the location on the touch screenwhere the user touch has occurred with a location on the navigationinformation display; and displaying a magnified area of a portion of thenavigation information proximate the location on the touch screen wherethe user touch occurred.
 2. The method according to claim 1 whereindisplaying a magnified area of the information display comprisesoverlaying the magnified area of the information onto the informationdisplay.
 3. The method according to claim 1 wherein sensing a touch by auser on the touch screen comprises at least one of: sensing the usertouch for a predefined period of time before considering the touch anintended touch; and sensing the user touch for a user defined period oftime before considering the touch an intended touch.
 4. The methodaccording to claim 1 wherein displaying a magnified area of thenavigation information comprises causing the magnified area to be movedabout the display based upon a sensed path of a prolonged touch by auser upon the touch screen.
 5. The method according to claim 4 furthercomprising changing a content of the magnified area according to arelative position of the magnified area with respect to the navigationinformation being displayed.
 6. The method according to claim 1 whereindisplaying a magnified area of the navigation information comprisesenclosing the magnified area within a boundary, the boundary beingdisplayed on the display of the device.
 7. The method according to claim1 wherein displaying a magnified area of the navigation informationcomprises displaying crosshairs within the magnified area.
 8. The methodaccording to claim 1 wherein displaying a magnified area of thenavigation information comprises displaying the magnified area above thelocation on the touch screen where the user touch has occurred.
 9. Themethod according to claim 1 further comprising: displaying thenavigation information and the magnified area in a first portion of thedisplay of the device; and displaying textual information related to themagnified area in a second portion of the display of the device.
 10. Themethod according to claim 1 further comprising displaying the portion ofthe navigation information outside of the magnified area as the portionwas displayed prior to the displaying of the magnified area.
 11. Themethod according to claim 1 further comprising removing the magnifiedarea from the display after a predetermined amount of time has passedsince a touch by a user on the touch screen has been sensed.
 12. One ormore computer-readable storage media having computer-executableinstructions embodied thereon, wherein when executed by at least oneprocessor, the computer-executable instructions cause the at least oneprocessor to: display navigation information on a touch screen displayof a device associated with the at least one processor; sense a firstuser touch on the touch screen; determine, by the device, a location onthe touch screen where the first user touch has occurred; correlate thelocation on the touch screen where the first user touch has occurredwith a location in the navigation information; and display at least onecharting tool proximate the location on the touch screen where the firstuser touch occurred, the at least one charting tool overlaid over thenavigation information.
 13. One or more computer-readable storage mediaaccording to claim 12 wherein to display at least one charting toolproximate the location on the touch screen, the computer-executableinstructions cause the at least one processor to: determine, by thedevice, a location on the touch screen where a second user touch hasoccurred; correlate the location on the touch screen where the seconduser touch has occurred with a location on the navigation information;and display an indicator that is overlaid over the navigationinformation, the indicator extending from the location where the firstuser touch occurred to the location where the second user touchoccurred.
 14. One or more computer-readable storage media according toclaim 13 wherein to display an indicator, the computer-executableinstructions cause the at least one processor to display a text boxproximate the indicator, the text box including at least a bearing anddistance information from the location where the first user touchoccurred to the location where the second user touch occurred.
 15. Oneor more computer-readable storage media according to claim 12 wherein todisplay at least one charting tool proximate the location on the touchscreen, the computer-executable instructions cause the at least oneprocessor to display a magnified area of a portion of the navigationinformation proximate the location where the first user touch occurred.16. One or more computer-readable storage media according to claim 15wherein to display a magnified area of a portion of the navigationinformation, the computer-executable instructions cause the at least oneprocessor to: cause the magnified area to be moved about the displaybased upon a sensed path of a prolonged touch by a user upon the touchscreen; and change a content of the magnified area according to arelative position of the magnified area with respect to the navigationinformation being displayed.
 17. One or more computer-readable storagemedia according to claim 15 wherein to display a magnified area of aportion of the navigation information, the computer-executableinstructions cause the at least one processor to display the magnifiedarea above the location on the touch screen where the first user touchhas occurred.
 18. One or more computer-readable storage media accordingto claim 12 wherein to display at least one charting tool proximate thelocation on the touch screen where the first user touch occurred, thecomputer-executable instructions cause the at least one processor to:displaying charting tool in a first portion of the display of thedevice; and display textual information related to the charting tool ina second portion of the display of the device.
 19. A system fordisplaying electronic navigation charts, said system comprising: aprocessing device; a memory coupled to said processing device, saidmemory for storing data defining the electronic navigation charts; and adisplay comprising a touch screen, said display and said touch screencommunicatively coupled to said processing device, said processingdevice configured to: cause the electronic navigation charts to bedisplayed on said display; receive data from said touch screenindicating one or more user touches on said touch screen; determine,based on the data received from said touch screen, a location on saidtouch screen where the one or more user touches have occurred; correlatethe location on said touch screen where the one or more user toucheshave occurred with the data defining the electronic navigation charts;and cause at least one charting tool to be displayed on said displayproximate the location on said touch screen where the one or more usertouches occurred, the at least one charting tool overlaid over theelectronic navigation charts.
 20. The system according to claim 19wherein to display said at least one charting tool, said processingdevice is configured to display at least one of: an indicator and a textbox proximate the indicator, the text box including at least a bearingand distance information from the location where a first of the one ormore user touches occurred to the location where a second of the one ormore user touches occurred; and a magnified area of a portion of theelectronic navigation charts proximate the location where a user touchoccurred.